Network configuration backup and restore operations using continuous data protection

ABSTRACT

Systems and methods for performing replication operations on a continuous data protection system. Exemplary systems include a continuous data protection system configured to save a series of transactions of a production application, the continuous data protection system configured to allow a point in time view of the series of transactions, a replication application communicating with the continuous data protection system, the replication application configured to initiate generation of at least one pseudosnapshot of the series of transactions saved on the continuous data protection system and initiate surfacing of a copy of at least a portion of the series of transactions that were saved before the generation of the at least one pseudosnapshot, and a remote server communicating with the replication application, the remote server configured to send replication instructions to the replication application.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is related to co-pending U.S. patent application Ser.No. 11/381,336, filed May 2, 2006, co-pending U.S. patent applicationSer. No. 11/381,339, filed May 2, 2006, co-pending U.S. patentapplication Ser. No. 11,381/347, filed May 2, 2006, and co-pending U.S.patent application Ser. No. 11/381,345, filed May 2, 2006. All of theseapplications are incorporated by reference herein in their entireties.

BACKGROUND OF THE INVENTION

1. The Field of the Invention

The present invention relates to systems and methods for backing up andrestoring data. More particularly, embodiments of the invention relateto systems and methods for performing replication operations on acontinuous data protection system.

2. The Relevant Technology

In this society where many personal and business interactions are datadriven, data can become easily lost or corrupted due to events such assystem failures, viruses, power outages, etc. Backing up data has becomean important feature of computer networks because of this increasingdependence upon computers and networks to perform vital business andpersonal functions. The ability to easily, accurately and reliablyaccess data is expected by anyone accessing a computer and/or network.

Backup and recovery of data is typically accomplished through the use ofsoftware that creates a backup copy of data and that recovers the datafrom the backup copy. As the amount of data continues to increase, andas the applications for creating data become more complex, backing upand recovering the data becomes more challenging. It would beadvantageous to be able to restore the data at optimal points in time sothat full recovery of all of the desired data is achieved withoutcorrupting other data or processes on a computer.

BRIEF DESCRIPTION OF THE DRAWINGS

To further clarify the above and other features of the presentinvention, a more particular description of the invention will berendered by reference to specific embodiments thereof which areillustrated in the appended drawings. It is appreciated that thesedrawings depict only typical embodiments of the invention and aretherefore not to be considered limiting of its scope. The invention willbe described and explained with additional specificity and detailthrough the use of the accompanying drawings in which:

FIG. 1 illustrates an example of a system for performing replicationoperations on continuous data protection systems.

FIG. 2 illustrates an example of a system for performing replicationoperations using continuous data protection.

FIG. 3 illustrates an example of a method for storing protection sets ona continuous data protection engine.

FIG. 4 illustrates an example of a method for generating apseudosnapshot on a continuous data protection engine.

FIG. 5 is a depiction of pseudosnapshots and surfaced copies, inaccordance with the present invention.

FIG. 6 illustrates an example of a method for surfacing a copy from acontinuous data protection engine to provide a replication operation.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

In the following detailed description of the various embodiments,reference is made to the accompanying drawings which form a part hereof,and in which are shown by way of illustration specific embodiments inwhich the invention may be practiced. It is to be understood that otherembodiments may be utilized and structural changes may be made withoutdeparting from the scope of the present invention.

The principles of the present invention relate to a system configuredfor creating pseudosnapshots using continuous data protection (CDP)techniques and then surfacing at least a portion of the CDP data as acopy to perform various replication operations. Data from a surfacedcopy can be used for mirroring functions, backup/recovery operations(e.g., disaster recovery), data mining, data consistency, as well asother analysis.

Exemplary systems include a production application residing on acomputer and a CDP engine configured for continually storing changesthat occur in the production application. Each time data is written bythe production application that is being protected, the CDP engine istriggered and a copy of the data involved in the write operation iscreated and stored on the CDP engine. The CDP engine basically performsa continuous series of write operations. The CDP engine is able toretain information about every change to a selected application,directory, volume, or the like, over a long period of time, and a usercan later utilize the CDP engine to access stored data as it appeared ata given point in time in the past.

The present invention provides for pseudosnapshots to be created of thedata stored in the CDP engine at various points in time. If theproduction application becomes corrupted, a previous version of theapplication data may be recovered using one or more of thepseudosnapshots by surfacing a copy from the CDP engine and reading thedata from the surfaced copy to recreate the data up until the time thepseudosnapshot was created.

As used herein, the term “data” may include, but is not limited to,directories (e.g., volumes, file systems, and the like), user data,system data, applications, services, operating systems, and the like,that can be stored on one or more storage devices of a computer. Backingup or recovering the operating system may include backing up orrecovering any of the data herein defined or understood by those ofskill in the art. Data may be organized in logical directories that donot necessarily correspond to a particular storage device. The term“directory” can be used interchangeably with the term “volume” or “filesystem” to refer to any means of logically organizing data on acomputer.

Even though data may exist on many different storage devices, data canbe organized into logical directories and subdirectories so that a usercan easily locate information. In one example, in Windows® operatingsystem, the main directories are referred to as volumes. Volumesinclude, for example, the C drive and D drive, which are typical volumesof storage that are located on a computer, even though the C or D driveitself may comprise a collection of hard disks. It is not necessary fora user to know from which particular disk to obtain information. Thus,directories exist to help a user navigate through data on the computer.Other directories may exist to which the computer has access through anetwork.

For purposes of simplicity, the term “production application” will oftenbe used herein to describe the source of data that is being backed up.As will be described below, complex software applications benefit fromthe backup and restore technology disclosed herein because the datarelated to applications are typically subject to constant alteration.The technology disclosed herein facilitates the backup and recovery ofall types of data and/or data structures, and can be particularlybeneficial to applications whose data is continually changing. Althoughcertain embodiments described herein will often refer to the backup ofproduction applications, the technology described herein applies equallyto the backup and recovery of all types of data, including directories,volumes, file systems, servers, user data, system data, services,operating systems, and the like.

Certain embodiments described herein will involve electroniccommunication between a client computer system (hereinafter referred toas a “client”) requesting access to a network service at a servercomputer system (hereinafter referred to as a “server”). Accordingly,the client sends a request to the server for particular access to itssystem resources, wherein if the client is authorized and validated, theserver responds with a response message providing the desiredinformation. Of course, other messaging patterns between client andserver are available, as are well known in the art.

As used herein, the term “user” may refer to a person operating theserver (e.g., administrator). Alternatively, the term “user” may referto a person at a client or management console. Users are able toinitiate a request for mirroring, backup and/or restore, although itwill be appreciated that the server may have additional functionalitiesnot available to the client or management console.

To facilitate the various replication functions contemplated by thepresent invention, pseudosnapshots can be generated in the CDP engine bycreating event markers at points in time when the data is in, forexample, a quiescent state. Pseudosnapshots are, thus, earmarkeddatasets within the CDP engine that can later be reliably surfaced as acopy. Pseudosnapshots provide the user with greater control over howdata is stored to and recovered from the CDP engine. Thesepseudosnapshots can be recovered at a later time by reading the datathat had been stored in the CDP engine at the time of the correspondingevent marker. Furthermore, because pseudosnapshots consist of eventmarkers, the number of pseudosnapshots that can be earmarked in the CDPdata can be numerous because the data is surfaced to copy only whenneeded. Thus, numerous pseudosnapshots can be saved, reducing the amountor resources and storage.

In contrast, a conventional snapshot is a read-only point-in-timereplica or representation of the original data or contents of one ormore volumes. A conventional snapshot can be used to make an actual copyon another local or remote storage device. While it would be beneficialto be able to make read only replicas of data on a CDP engine atspecific points in time, as is done with conventional snapshots, suchuse can consume storage space and resources. In order to store the samenumber of conventional snapshots as pseudosnapshots, a larger amount ofstorage would be required. Thus, the present invention allows for areduced amount of resources and storage to be used to store numerouspseudosnapshots, if so desired. The present invention thus obviates theconflict that arises where a user would like to take advantage of thepoint-in-time nature of CDP, while maintaining the stability of beingable to use a snapshot that was created while crucial applications onthe volume were in a consistent state. The present invention providessystems and methods for integrating the benefits of CDP with snapshottechnology.

Pseudosnapshots can be beneficial, for example, to facilitate datarecovery after the occurrence of a disaster. A disaster may include anyevent in which data is lost or corrupted in any way, or when anoperating system or other application is corrupted or damaged in any waythat may require the operating system or application to be repaired orreinstalled. Data may be lost, damaged or corrupted in any number ofways, including a system crash, burglary, virus, human error, damage tothe system, and the like. A pseudosnapshot can be used to surface acopy, which can then be used to create a backup copy of data on the CDPengine. The backup copy of data can be transferred to a backup storagemedium, such as an optical disk, hard disk, floppy disk, tape, or anyother storage medium that can be physically stored in a locationseparate from the CDP engine.

Exemplary System For Performing Replication Functions Using ContinuousData Protection

FIG. 1 illustrates an exemplary system 100 for creating pseudosnapshotsusing continuous data protection (CDP) technology. System 100 furtherperforms various replication functions such as mirroring and remotebackup/recovery. FIG. 1 depicts a computer 102 that is in communicationwith a storage area network (SAN) 108. In one embodiment, computer 102is an individual computer. In another embodiment, computer 102 is aserver that is in communication with a network of client computers (notshown). In another embodiment, computer 102 is a client computer that iscommunicatively coupled to a central server (described below). Computer102 can be relatively simple (e.g., a desktop computer) or relativelycomplex (e.g., a large database server, a cluster of servers, or aproduction server).

Computer 102 further includes at least one production application 104,which contains and generates data that can be stored, mirrored, backedup, recovered, data mined, and the like. As noted above, the term“production application” is merely used by way of example to furtherillustrate the present invention, because complex applications whosedata is continually being altered can benefit from the technologydisclosed herein. However, other data on computer 102 that may alsoundergo storing, mirroring, backing up, data mining, and the like, whichdata may also include directories, volumes, file systems, servers, andother types of data described previously.

Furthermore, production application 104 may be comprised of multipleapplications, located on multiple computers, volumes, directories,disks, or the like. By way of example only, production application 104may include Oracle, SAP, Microsoft Exchange, and Microsoft SQL,PeopleSoft, Seibel, among other flexible enterprise resource planning(ERP) software applications and may operate on any of various differentoperating systems including, by way of example, Windows, Linux, NetWare,and UNIX platforms.

Computer 102 includes at least one replication application 106 thatperforms various replication functions. In one embodiment, replicationapplication 106 can be responsible for managing mirroring operations ofcomputer 102. In another embodiment, replication application 106 may beconfigured to perform automated backup and recover operations ofcomputer 102. Replication application 106 may further be configured fordelivering data protection and management for direct attached storage(DAS), network attached storage (NAS), storage area network (SAN),continuous data protection (CDP) and other storage environments.

Although replication application 106 may consist of backup-restoresoftware features from any number of manufacturers, replicationapplication 106 may include various features, including, but not limitedto, advanced indexing, high speed parallelism, automated mediamanagement, LAN-free backup, cluster awareness, and dynamic tape drivesharing. Further, replication application 106 can also coordinatecreation of pseudosnapshots to perform other functions besides mirroringand backup/recovery, such as, but not limited to, data mining, dataconsistency analysis, and the like.

System 100 may further include a primary storage 120. Primary storage120 may be one of many storage mediums that are commonly employed in theart to store data.

Examples include, but are not limited to, disk storage (e.g., opticaldisks, hard disks, RAIDs, floppy disks, zip disks, and the like), tapestorage (e.g., magnetic tape, paper tape), solid state memory devices(e.g., flash memory, EEPROM, and the like), as well as any other storagemedium currently known in the art or developed in the future.

System 100 also includes a continuous data protection (CDP) engine 110for recording a copy of all changes made to the data of productionapplication 104. Computer 102 further includes a data tap 112 thatserves as an interface between computer 102 and CDP engine 110. Data tap112 consists of a software component configured to intercept all of theinputs and/or outputs that are sent to and from production application104. Data tap 112 sends each of the changes occurring in productionapplication 104 to CDP engine 110. In one embodiment, data tap 112includes a CDP application programming interface (API) 113 to allowapplications or services to contact CDP engine 110.

As production application 104 receives or transmits input/outputoperations, which is only one example of generating data, theinput/output data is intercepted by data tap 112. In one embodiment, theinput/output data is sent from production application 104 to CDP engine110. In an alternative embodiment, data can first be sent to replicationapplication 106 which relays the input/output data to data tap 112. CDPengine 110 records each input/output data transaction.

CDP engine 110 may include a write journal 111 as well as one or morevolumes 115. The data stored in CDP engine 110 is initially written towrite journal 111. As copies of the write journal are mirrored toprimary storage 120, the mirrored data is stored in volumes 115 on CDPengine 110 and the write journal 111 maintains new I/O transactions fromthe time of the last mirroring operation.

CDP engine 110 includes an index 117 for recording metadata containinginformation about the contents of the CDP engine 110, including volumes115 and write journal 111, and the location of corresponding volumes 121at primary storage 120. The CDP engine 110 can be accessed to provide apoint-in-time recovery of the production application 104 or of any otherdata being protected by the CDP engine 110 where the data is located inthe write journal 111. In other words, the CDP engine can be used torestore a protected application 104 to the same state the application104 was at any point in time in the past using the write journal 111. Incontrast, many other replication or mirroring technologies may onlyallow a user to recover data at certain points in the past or the mostrecent copy. In one embodiment, CDP engine 110 is a Linux host, whichacts as an array to provide continuous data protection.

The foregoing configuration allows for the mirroring of data in primarystorage 120 and CDP engine 110. The replication application 106 controlsthe timing and movement of data from the CDP engine 110 to the primarystorage 120. At certain predefined intervals, the data in the writejournal 111 can be copied over to the primary storage 120 by firstcreating volumes 115 in CDP engine 110 and then copying over the volumesto primary storage 120, represented by volumes 121. For example, thevolumes 121 may represent various protection sets of productionapplication 104 data that are saved. Thereafter, the data represented bywrite journal 111 is written over (i.e., replaced) by new data writtento CDP engine 110 from inputs/outputs of production application 104. Thenew data represented by write journal 111 is periodically copied over toprimary storage 120 at predefined intervals, and, hence, the volumes 115in CDP engine 110 will be updated with the new data as well. In oneembodiment, an event marker can be placed in volumes 115 to indicatethat a mirroring event has occurred.

The foregoing configuration provides both the ability to mirror datafrom the CDP engine 110 to the primary storage 120 and the ability toaccess point-in-time data at the CDP engine 110. This configurationprovides multiple layers of redundancy to ensure that a reliable copy ofdata may be recovered in the case of disaster where data is lost orcorrupted. If the primary storage 120 fails, the CDP engine 110 is ableto restore the data saved in volumes 115 and write journal 111 toprimary storage 120 at a particular point in time. Likewise, if the CDPengine 110 fails, the primary storage 120 is able to restore the datastored in volumes 121 back to the CDP engine 110.

Computer 102 includes a graphical user interface 122 that can beconfigured to display the contents of CDP engine 110 and/or primarystorage 120 in an organized manner, such as by displaying volumes with ahierarchical structure. Graphical user interface 122 may also allow theuser to configure CDP engine 110 to ensure that the CDP engine hassufficient storage allocated to protect a particular volume, directory,or application. The graphical user interface 122 can also be used tocreate pseudosnapshots and to select copies to be surfaced. Because theCDP engine 110 may store data on disk rather than on tape storage, thepresent invention allows files or entire volumes to be easily copied andsaved back to the primary storage or to another location for performingother functions on the data such as backup/recovery, data mining or dataconsistency analysis.

FIG. 1 further illustrates an embodiment that allows pseudosnapshotsand/or surfaced copies to be requested from a remote computer. Forexample, computer 102 can communicate with an analysis computer 150.Analysis computer 150 can request files or data from CDP engine 110 tobe analyzed using, for example, data mining or data consistencytechniques. This remote access of data can include requests to generatepseudosnapshots and/or requests to surface a copy based on a previouslycreated pseudosnapshot.

In addition, FIG. 1 illustrates that data from the CDP engine 110 can besaved and recovered on a remote storage. Computer 102 can communicatewith a server 152 to perform data backup/recovery functions. Thus, inone embodiment, the request for creating a pseudosnapshot or surfacing acopy can be generated by server 152 instead of client computer 102. Itwill be appreciated that the server 152 may have additionalfunctionalities not available to the client computer 102. The server 152may further be configured for controlling other backup operations. Forexample, the server 152 may control and direct all server-initiatedbackup operations or processes, while the computer 102 may control adhoc backup and recover operations.

In FIG. 1, the server 152 has access to backup storage 154 where one ormore copies of the client's data can be stored. The backup storage 154can be located at the server 152 or may be distinct and separate fromthe server 152. The data 156 represents the data that has been backed upby the server 152 on the backup storage 154. The data 156 may includedata recovered from the CDP engine in the form of a surfaced copy, ormay also include other data, such as the data stored on computer 102,data from primary storage 120, or data from other sources.

The backup and recovery operations performed by the server 152 on thedata of computer 102 are typically performed automatically in accordancewith a schedule established by a user. However, as described above,users of the computer 102 may initiate backup operations directly fromthe computer 102. When the server 152 performs a backup of data in theCDP engine 110, in one embodiment, computer 102 can ensure that theappropriate protection sets associated with the backup operation arebacked up while in an application consistent state. This may beperformed by quiescing the applications included in the relevantprotection sets prior to performing the backup operation, as previouslydescribed.

The server 152 may also store and manage a client file index 158 and amedia volume 160 both on the server 152 itself and/or on the backupstorage 154. The client-file index 158 is an index of the backed up dataitems. The media volume 160 is an index of the backup volumes. Theclient file index 158 and the media volume 160 are collectively referredto herein as the “online indexes”. The online indexes are typicallystored on the backup storage 154 after the backup operation is complete.However, it will be appreciated that other operating systems may usesimilar data structures for maintaining the directories and backed upitems in order to restore the directories and items during recovery.

As previously mentioned, computer 102 can perform both the creation of apseudosnapshot, and the surfacing of a copy. Once computer 102 hassurfaced a copy, the data on the surfaced copy can be utilized similarto a traditional snapshot. For example, the data on the surfaced copycan be used to perform mirroring operations. The data on the surfacedcopy can be used to perform a remote backup copy of the data. Theremotely backed up data can then be used to recover data that has beenlost during a disaster. Further, the data on the surfaced copy can beused for data analysis, such as data mining, data consistency checking,and the like. As also shown in FIG. 1, analysis computer 150 and server152 may also communicate directly with SAN 108 or CDP engine 110 toobtain the surfaced copies.

As discussed below, while the present invention allows data to be backedup at various points in time, certain points in time can be earmarked as“application consistent” points in time where it is desirable thatcritical components of the operating system state be backed up andrecovered as a consistent unit.

Exemplary Software Architecture For Performing Replication Operations onContinuous Data Protection Systems

With reference to FIG. 2, another embodiment of a system or softwarearchitecture 200 is illustrated in detail, wherein like elements withregard to FIG. 1 will be referred to with the same reference numeral.System 200 illustrates an exemplary software architecture that canoperate on computer 102 and/or other hardware components in furtherdetail. Replication application 106 may further include a snapshotmanager 206, which is a software component which may be configured tomanage the creation of pseudosnapshots, control the scheduling ofpseudosnapshot creation, and manage pseudosnapshot recoveries. Thesnapshot manager 206 may also include functions for converting thehigh-level task of generating a pseudosnapshot to application-specifictasks. Replication application 106 receives instructions to perform areplication function, sends a request to snapshot manager 206 toinitiate generation of a pseudosnapshot, and manages all aspects ofbackup and recovery for computer 102.

Replication application 106 further includes one or more snapshotcontrol managers (SCM) 208A, 208B, 208C that serve to facilitatecommunication between the snapshot manager 206 and various storageservices that may operate on different platforms with which replicationapplication 106 communicates. Various storage services 210A, 210B areillustrated that can operate in parallel with CDP engine 110. That is,CDP engine 110 is one example of a storage service 210. By way ofexample and not limitation, storage services 210A, 210B can be, but arenot limited to, CLARiiON, Symmetrix, LSI, IBM, and other systems. Thesnapshot manager 206 will invoke the CDP engine 110 through the CDP SCM208C. SCM 208C provides snapshot manager 206 with a common interface forperforming replication operations while abstracting away storagearchitecture details, similar to the other SCM 208A, 208B. The snapshotmanager 206 determines which storage service 210A, 210B, 110 is neededand makes calls to the appropriate SCM 208A, 208B, 208C.

Snapshot manager 206 may include various translation modules that haveknowledge of specific applications, such as Exchange, SQL, Oracle, andSAP. The translation modules can communicate with the various productionapplications 104 to find out where the applications 104 are storing dataso the snapshot manager 206 will know which SCM 208A, 208B, 208C tocommunicate with, in which drive or directory a file may be located, andthe like.

Replication application 106 communicates with a replication manager 217that is able to coordinate replication of data tasks, and does so acrossa number of technologies and client environments. Exemplarily,replication manager 217 includes various modules such as a sessionmanager that coordinates and schedules various replication sessions, andother modules responsible for, but not limited to, discovering arraysand storage, initializing of a replica, creation of a replica,validation of a replica, restoration of a replica, and deletion of areplica. Scheduling includes a series of policies and preconfiguredparameters that define the frequency at which pseudosnapshots are to becreated, among other details.

Replication manager 217 can further manage indexing of pseudosnapshotsin case the user needs to access them again, but does not have a tie-into online or offline media, e.g., storage tapes. In one embodiment, theindex of pseudosnapshots can be maintained at the replicationapplication 106. Replication application 106 can communicate withoffline media through a remote server 152 (see FIG. 1). Thus,replication application 106 can operate through replication manager 217to perform replication functions. In addition to coordinating thescheduling of the tasks from the replication application 106,replication manager 217 can also act as a facilitator for a number ofother tasks that require any sort of duplication of data.

Further, replication manager 217 coordinates various replication tasksthat may occur on one or more of the storage services 210simultaneously. For example, if storage services 210A and 210B areCLARiiON and Symmetrix storage systems, respectively, and productionapplication 104 is a SQL and Exchange database, replication manager 217assists in making copies of disks by communicating specifically to thestorage services 210A, 210B. All of the replication tasks can be doneusing features that come with the storage service, but each storageservice has its own command set, syntax, and idiosyncrasies. Replicationmanager 217 communicates with each storage service 210A, 210B so thatthe work of communicating with each storage service 210 is hidden fromthe user.

In one embodiment, replication manager 217 functions as a detachedprocess from replication application 106 and snapshot manager 206. Forexample, replication manager 217 can operate as a daemon on Unixplatforms or as a service on Windows operating environments. Replicationmanager 217 includes a replication manager API 216 to provide aninterface for other utilities, e.g., CDP SCM 208C, among others, toaccess the replication manager 217.

System 200 also includes a data tap 112, which intercepts all of thechanges to production application 104, and records the changes in theCDP engine 110, as described above. By continually recording each changeto production application 104, the CDP engine 110 always has a currentversion of the production application 104 that may be accessed in thecase of a disaster. The CDP engine 110 may also be configured to retaindata in a manner that the production application 104 may be restored toany prior point-in-time status. Data tap 112 can include a CDP API 113that the other utilities, e.g., replication manager 217, can use tocommunicate with the data tap 112.

As also shown in FIG. 2, computer 102 includes a configuration utility211 that is initiated anytime CDP engine 110 is involved with anyconfiguration function. The configuration utility 211 allows a user tocreate, modify, and delete protection sets, and control which volumes,drives, subdirectories, files, and the like will be included in aprotection set to be protected by the CDP engine 110. In further detail,configuration utility 211 can be used to inform the CDP engine 110 whichvolumes are to be protected, and how to perform such protectionoperation. The configuration utility 211 will gather information fromthe user with regard to the CDP engine to be used, will createprotection sets on the CDP engines, and will persist the resultinginformation in configuration database 214 to allow access by the CDP SCM208C. Ultimately, the CDP SCM 208C uses the persisted protection setdata saved during configuration when interacting with the replicationmanager 217 to create pseudosnapshots using the CDP technology. The CDPSCM 208C uses this configuration information to logon to the CDP enginesvia the replication manager 217.

The configuration utility 211 includes a CDP configuration API 212 and aconfiguration database 214. The CDP configuration API 212 allows accessto the configuration database 214. The configuration data for accessingCDP engine 110 can be stored at a configuration database 214.Configuration database 214 may also store authentication credentials forcommunicating with the CDP engine 110, identification information forattached CDP engines 110, details regarding protection sets that havebeen stored on the CDP engine 110, and the like.

The CDP initialization performed by configuration utility 211 is usuallyperformed the first time a user desires to store data from computer 102or primary storage 120 to CDP engine 110. Thereafter, anytimereplication application 106 wants to interact with CDP engine 110 (e.g.,replication application 106 wants to work off of a copy of data held atCDP engine 110), replication application 106 will use configurationutility 211 to communicate with the CDP SCM 208C. The configurationutility 211 will confirm that the requested data is held at or capableof being held at CDP engine 110 and any other information needed toaccess or store data at the CDP engine 110.

In order to prevent unauthorized access to the CDP engine, the CDPconfiguration utility 211 maintains the authentication credentialsrequired to communicate with the CDP engine 110, such as, but notlimited to, a username and password. Essentially, the configurationutility 211 allows an administrator to initiate communication betweenthe computer 102 and the CDP engine 110. A user or utility must providethe appropriate authentication credentials prior to writing to orreading from the CDP engine 110. Although FIG. 2 includes a single CDPengine 110, the system 200 may include two or more CDP engines, each ofwhich can be protected by unique authentication credentials. Afterconfiguring the CDP configuration utility 211, the configuration datafor accessing CDP engine 110 can be stored at configuration database214.

Finally, computer 102 may be configured such that the above benefits maybe implemented in an existing system having a replication application106 that is preconfigured for the creation and recovery of traditionalsnapshots. For example, as shown in FIG. 2, replication manager API 216may communicate with a VSS shadow copy service via a VSS API 215. VSSshadow copy service is one conventional method for creating snapshots onthe Windows operating systems.

In one embodiment, replication application 106, replication manager 217,configuration utility 211 and data tap 112 can be configured as a singlesoftware application. In another embodiment, replication application106, and replication manager 217 can be obtained from existing products,with an SCM 208C added to allow communication with CDP engine 110, whileconfiguration utility 211 and data tap 112 can be configured as aseparate marketed piece as indicated by the dashed line 218. Thisembodiment may be preferable where a computer already has a replicationapplication that is pre-configured for snapshot backup and recovery, butit would be desirable for the computer to have the additional benefitsof CDP, but without the expense of overhauling their entire snapshotreplication application.

In yet another embodiment, the functions of replication application 106and replication manager 217 may also be combined into a single softwareutility, if desired. In one embodiment, the configuration utility 211illustrated in FIG. 2 is separate from replication application 106.However, in other embodiments, the configuration utility 211 could bepart of or integrated with replication application 106. Finally,components shown external of computer 102 could be formed as an integralunit with computer 102 as indicated by dashed line 220.

Exemplary Method for Storing Protection Sets on a CDP Engine

Exemplary processes using the above exemplary architecture will now bedescribed. Initially, CDP engine 110 must be first populated with data.An exemplary method 300 for storing an initial protection set on CDPengine is illustrated in FIG. 3. A protection set is a set of one ormore data volumes to be protected using CDP technology. It will beappreciated that some of the stages of method 300 can be modified,performed in a different order, eliminated, and that additional stagesmay be added. Exemplarily, the stages of method 300 can be performedusing the systems 100 and 200 depicted in FIGS. 1 and 2, realizing thatother systems may be used to perform the stages thereof.

At 302, the configuration utility 211 is initiated and, as an initialmatter, needs to establish communication with the replication manager217. This can include the configuration utility 211 obtaining thereplication manager 217 service port and sending the service port to theconfiguration database 214. The replication manager 217 service port canbe obtained from different storage areas depending on the operatingsystem. For example, in Windows operating systems, the replicationmanager 217 service port can be persisted on the registry. For UNIXsystems, the replication manager 217 service port may be persisted in apersistent store identifiable by the configuration utility 211. Once theconfiguration database 214 has the service port for the replicationmanager 217, it does not need to obtain it again.

At 304, replication manager 217 initiates a session. In general, thereplication manager 217 may be responsible for managing variousoperations such as, but not limited to, performing a protectionoperation on a protection set, generating a pseudosnapshot, and thelike. For each operation, a session manager module on replicationmanager 217 tracks the session. A session is initiated by, for example,the configuration utility 211 making an API call (e.g., usingreplication manager API 216) to the replication manager 217 to start asession, which initiates a session manager at the replication manager217. Replication manager 217 returns a session handle to the initiatingutility, such as configuration utility 211.

At 306, the user selects the protection sets to save. In one embodiment,protection sets can be part of or an entire volume. Configurationutility 211 discovers volumes from, for example, the operating systemvolume enumeration service. For example, the configuration utility 211can make API calls to the operating system. Alternatively, replicationmanager 217 may have an API to discover volumes attached to the computer102. For example, one or more volumes may be from the primary storage120 connected to the computer 102. This may be the case where primarystorage has been the primary repository for storage for a productionapplication and it is desired to add a CDP engine in order to providemirroring capabilities. The available volumes are displayed on thegraphical user interface 122 and the user can select which volumes orfiles to include in a protection set to be used to populate CDP engine110.

At 308, the user selects one or more CDP engines on which to store theprotection set. This can include the configuration utility 211 making anAPI call (using replication manager API 216) to the replication manager217 which initiates a module for discovering storage. The discoverstorage sends a query through the data tap 112 by making an API call(using CDP API 113). The data tap 112 then sends the query to any CDPengines 110 to which the data tap 112 is connected. The data tap 112returns the identification of any CDP engines 110 to which it isconnected to the replication manager 217. The configuration utility 211can then request the results from the replication manager 217 whichreturns the identified CDP engine(s) 110. The identified CDP engines arethen displayed on the graphical user interface 122 and can be selectedby the user for storing protection sets desired to be protected.

Note that communication between configuration utility 211, replicationmanager 217, data tap 112, and CDP engine 110 can follow a similar pathof 302, 304, 306 and 308 using replication manager API 217 and CDP API113. In a session, generally, API calls include a session handle orsession identifier, along with the requested information.

At 310, authentication credentials are obtained and encrypted. The userenters authentication credentials through graphical user interface 122using authentication methods such as, but not limited to, a username andpassword. The configuration utility 211 sends the authenticationcredentials to the replication manager 217, which encrypts theauthentication credentials and sends the encrypted credentials to theconfiguration utility 211 to be stored in configuration database 214.

At 312, with the encrypted authentication credentials, the configurationutility 211 then proceeds to establish communication with the selectedCDP engine 110. Configuration utility 211 makes a logon request to thereplication manager 217, which then establishes a connection with theCDP engine 110.

At 314, the configuration utility 211 discovers the storage capabilitiesof the CDP engine 110. This can include configuration utility 211sending a discover target storage command to the replication manager 217which initiates a discover target storage module. The discover targetstorage module sends a request to the CDP engine 110 to discover itsstorage capabilities. Once the authentication credentials are encryptedat 310, all necessary communication with the CDP engine 110 is securelyencrypted and does not have to be done again until a session iscompleted. Querying the CDP engine 110 for its storage capacity caninclude the CDP engine 110 sending back the identity and state ofavailable storage medium, e.g., volume storage 115. Details relating tothe storage capabilities or protection resources that are available onthe CDP engine 110 can be displayed on the graphical user interface 122.

At 316, the user is able to select through the graphical user interface122 the amount of protection resources to use, which can be measuredagainst the amount of protection resources available. Such protectionresources can include, but are not limited to, the number of days ofstorage available, the estimated change rate, and the amount ofavailable storage. For example, a user can select particular storagemediums on CDP engine 110 the user wishes to use for protection storage.

At 318, computer 102 creates a protection set for specified productionvolumes. This can include initiating an initialize replication module inthe replication manager 217. The initialize replication module cancompare the protection set items with the identified storage medium atCDP engine 110 to compare the amount of storage needed versus storageavailable to ensure that they are consistent. After checkingconsistency, the CDP engine 110 can return a device map that can bepersisted in the configuration database 214 that can exemplarily showwhere in the CDP engine 110 the protection set is stored.

At 320, configuration utility 211 dismounts production applicationobjects prior to starting protection of the selected protection setitems. Dismounting the production application objects makes themunavailable to the user or to other applications to prevent data in theprotection set from being changed while the protection set is beingcopied to the CDP engine 110. Prior to or during the dismounting of theproduction application object, the configuration utility 211 orreplication application 106 places the production application 104 in aquiescent state.

At 322, the configuration utility 211 signals the initialize replicamodule in the replication manager 217 to instruct the CDP engine 110 tostart the protection operation. During the protection operation, the CDPengine 110 makes a full copy of the protection set items onto CDP engine110. The CDP engine 110 may provide protection progress updates toconfiguration utility 211. When the CDP engine 110 completes theprotection operation, it sends an operation complete signal to theconfiguration utility 211.

At 324, the configuration utility 211 may relocate productionapplication objects. Relocating the production application objectsessentially renames the application volume. The new name should be usedthereafter in order for the application object to be protected using CDPtechnology. At 326, configuration utility 211 persists a protection seton the configuration database 214.

Exemplary Method for Creating a Pseudosnapshot

FIG. 4 illustrates an exemplary method 400 for creating apseudosnapshot. It will be appreciated that some of the stages of method400 can be modified, performed in a different order, eliminated, andthat additional stages may be added. Exemplarily, the stages of method400 can be performed using the systems 100 and 200 depicted in FIGS. 1and 2, realizing that other systems may be used to perform the stagesthereof.

At 402, the replication application 106 receives a request to create apseudosnapshot. The request can be made as part of a regularly scheduledcreation of pseudosnapshots. Alternatively, a request to create apseudosnapshot can be made on an ad hoc basis. Replication application106 recognizes the request to access the CDP engine 110 and initializesthe snapshot manager 206 and SCM 208C.

At 404, SCM 208C makes an API call using replication manager API 216 toreplication manager 217 to establish a session using the session managermodule. When the session is established, the SCM 208C loads andvalidates the format of the configuration database 214.

At 406, the snapshot manager 206 determines whether the CDP engine 110is capable of creating a snapshot, i.e., whether the CDP engine 110contains the data required to generate a snapshot. To ascertain this,the SCM 208C can simply query configuration database 214 to determine ifthe appropriate data is present (the appropriate data may havepreviously been stored as a structured text file readable by the user,but also known by the configuration utility in configuration database214 during a protection set storage operation, described in method 300).

At 408, the SCM 208C logs onto the CDP engine 110. This can include theSCM 208C obtaining the CDP engine credentials from the configurationdatabase 214 to log onto the CDP engine 110.

At 410, the CDP engine 110 reports of available data on which to createa pseudosnapshot. This can include SCM 208C requesting replicationmanager 217 to query the protection set at the CDP engine 110.Replication manager 217 may use a storage discovery module to query theCDP engine 110 for a protection set. The CDP engine 110 returns the CDPgroup object to the replication manager 217.

At 412, in one embodiment, replication application 106 sends aninstruction to production application 104, requesting the application totemporarily quiesce (i.e., temporary enter an inactive state). By way ofexample, upon receiving the instruction to quiesce, the productionapplication 104 may complete any operations that must be completed toachieve consistency, and/or may flush its buffers and memory to atemporary storage location. In one embodiment, production application104 will send a notification to replication application 106 or snapshotmanager 206 upon entering a quiescent state.

At 414, CDP engine 110 creates a pseudosnapshot. This can includesnapshot manager 206 sending an instruction to replication manager 217which initiates a create replica module. The instructions may include adata structure that describes the protection set against which an eventmarket should be created. (This data structure can also be persisted inthe configuration database 214.) The event marker is a data structurethat may exemplarily contain information regarding the time at which thepseudosnapshot was created (i.e., the time at which the last change wasmade to the CDP engine 110 prior to the placement of the event marker).Replication manager 217 sends the instruction to CDP engine 110 tocreate an event marker at the appropriate point in time. The eventmarker may also be generated by the replication manager 217, CDP engine110, snapshot generator 206, or the SCM 208C. The event marker may bestored at computer 102, CDP engine 110, or primary storage 120, as wellas at a remote location, such as server 152.

The CDP engine 110 returns the results (i.e., operation successfullycompleted or operation failed) to the replication manager 217, which isforwarded to the snapshot manager 206. The snapshot is “pseudo” becausewhile the pseudosnapshot data may appear to have the properties ofconventional read-only snapshot from the perspective of the snapshotmanager 206, when a pseudosnapshot is created, no snapshot is actuallycreated on any storage disk. Instead, an event marker is created at thetime the pseudosnapshot is created to allow a copy of the data to besurfaced from the CDP engine 110 up until the point in time at which theevent marker was created. If desired, the surfaced copy can be formattedto have the properties of a conventional read-only snapshot. CDP engine110 may also send a pseudosnapshot handle to replication manager 217including an identifier of the CDP engine on which the relevant data isstored, an identifier for the protection set that is being protected,and an event marker.

At 416, the replication application 106 may catalogue the createdpseudosnapshot in an index in the same manner as would be done forcreation of a conventional snapshot so that replication application 106has record of the pseudosnapshots that can be accessed at a later pointin time. For example, the index of the pseudosnapshots may be stored atthe backup/recovery server 152.

At 418, after the event marker has been created, replication manager 217may send a command to configuration utility 211 and/or the replicationapplication 106 to close the pseudosnapshot session so that the computer102 may resume its normal operation.

As snapshot manager 206 requests more pseudosnapshots, CDP engine 110generates more event markers, thus resulting in an entire collection ofpseudosnapshots. The event marker provides the system and user withinformation regarding the time at which the pseudosnapshot was created.Therefore, a user viewing the data on graphical user interface 122 mayperceive a large number of potential copies that can be surfaced.However, in reality the CDP engine 110 is simply storing a series ofevent markers, but is able to surface the data to reflect a copy of datafor each pseudosnapshot. As will be described further below, the data inCDP engine 110 can thus be viewed at points in time by selecting one ofthese event markers, and requesting a surfacing of a copy up until thepoint in time of the event marker, which surfaced copy can be displayedand selected using graphical user interface 122.

Graphical user interface 122 allows the user to manage all the eventmarkers. Because the collection of event markers may grow quite large,graphical user interface 122 allows the user to view the event markersin an organized manner and select them quickly and efficiently. Asdiscussed above, when the graphical user interface 122 displays theevent markers (i.e., pseudosnapshots) to the user, the data may beorganized into volumes, directories, and files, in order to correspondto the organization contained in CDP engine 110. In one embodiment, acatalogue of event markers can also be stored on server 152 in a mediadatabase and used for recovery purposes. Further, the graphical userinterface 122 also allows the user to establish a schedule for definingthe times at which the pseudosnapshots of selected protection sets willbe created. However, users on the clients can also initiate ad hoccreation of pseudosnapshots. Scheduling may include establishing aseries of policies and preconfigured parameters that define thefrequency at which pseudosnapshots are to be created, among otherdetails. The graphical user interface 122 may communicate theinformation received from the user to replication application 106, theconfiguration utility 212, or replication manager 217 as necessary.

The frequency at which a user may schedule the creation ofpseudosnapshots may vary widely, depending on the needs of a system andapplication being protected. For example, an application that undergoesfew changes may only require the creation of a pseudosnapshot everyfifteen minutes to an hour. Conversely, a user may schedule the creationof a pseudosnapshot every minute or less where the application beingprotected is constantly changing critical data. Furthermore, becausepseudosnapshots require only a minimal amount of memory in addition tothe memory already required by the CDP engine, the number ofpseudosnapshots that can be indexed is only limited by the size of theCDP engine. Therefore, millions of pseudosnapshot can potentially bestored, as opposed to a traditional snapshot system, which normallycould only hold a few snapshots.

Where pseudosnapshots correspond to quiesced states, the only limitationon how often a pseudosnapshot is created is the quiesce time of theapplication being protected. Because pseudosnapshots can be created inthe time it takes the application to quiesce, pseudosnapshots can becreated much more often than actual snapshots can typically be createdin a traditional snapshot system. As quiescing time becomes shorter andshorter, pseudosnapshots can potentially have the same fine level ofgranularity that is provided by CDP systems.

FIG. 5 is provided as one simplified depiction of the relationshipbetween the data stored within, for example, the write journal 111 ofthe CDP engine 110 and the event markers that signify the existence of apseudosnapshot. FIG. 5 includes a depiction of a write journal 111,including a plurality of transactions, identified by boxes. Thetransactions of write journal 111 (which can be inputs and outputs sentto and from production application 104) are chronological and so a T₀indicates the starting time of the write journal. Therefore, as timeprogresses, the boxes of write journal 111 are filled with new data fromproduction application 104 from left to right. As stated above, thepresent invention is simplified and the actual storage of data and theaddressing scheme within the write journal 111 may be much more complexthan shown in FIG. 5.

After certain transactions have been recorded in the write journal 111,an event marker may be created. FIG. 5 depicts the creation of fivepseudosnapshots (i.e., after transactions 502A, 502B, 502C, 502D, and502E) during the time write journal 111 is generated. Each time acommand is received that a snapshot be created, an event marker isgenerated, as described above. The arrows labeled 504A, 504B, 504C,504D, and 504E represent event markers which are “placed” at thepoint-in-time when the pseudosnapshot is created. Although the term“placed” is used in order to assist in the visualization of eventmarkers, the actual event markers do not have to be stored with the datain the write journal 111. Instead, the event markers may merely includethe time and date at which the pseudosnapshot is created, thusidentifying the last entry within the write journal 111 before thesnapshot was created. Therefore, event marker 504A identifies thetransaction 502A, event marker 504B identifies the transaction 502B,event marker 504C identifies the transaction 502C, event marker 504Didentifies the transaction 502D, and event marker 504E identifies thetransaction 502E. Alternatively, the first entry immediately after anevent marker is created could also be used to identify the existence ofa pseudosnapshot. In this manner, a large number of pseudosnapshots maybe generated and stored while minimizing the amount of storage necessaryto accommodate the pseudosnapshots.

Exemplary Methods for Surfacing a Copy Using a Pseudosnapshot

Once the pseudosnapshots have been created using the techniquesdescribed above, a user has the option of surfacing a copy whichcontains an image of any of the data actually corresponding to apseudosnapshot. The process of surfacing a copy includes the selectionof a pseudosnapshot. For example, in one embodiment, a user may enter atime in the past up until which the user wishes to surface a copy.

After the user selects a pseudosnapshot, SCM 208C then surfaces a copyby reading the data stored in the CDP engine up until the point in timethat the event marker corresponding to the selected pseudosnapshot wascreated. SCM 208C formats this data into a data structure that has theappearance of a traditional snapshot from the perspective of snapshotmanager 206 and replication application 106.

FIG. 6 illustrates an exemplary method 600 for surfacing a copy from CDPengine 110. It will be appreciated that some of the stages of method 600can be modified, performed in a different order, eliminated, and thatadditional stages may be added. Exemplarily, the stages of method 600can be performed using the systems 100 and 200 depicted in FIGS. 1 and2, realizing that other systems may be used to perform the stagesthereof.

Periodically, the replication application 106 inventories the availablepseudosnapshots. This can occur, for example, when replicationapplication 106 requests a recovery operation. An index containing alist of available pseudosnapshots can be located on computer 102, thebackup/recovery server 152, or other location. Alternatively,replication application 106 may query CDP engine 110 or a remote server152 that may contain an index of pseudosnapshots for CDP engine 110.

At 602, a user selects a protection set that should be recovered fromCDP engine 110. The protection set may include any data from productionapplication 104, and data from any other application, volume, disk, orthe like, that has been backed up on CDP engine 110. The protection setmay be manually selected by the user, or automatically selected in lightof properties that correspond to a pseudosnapshot selected for recoveryby the user.

At 604, replication application 106 initializes a session. As discussedabove, this can include the SCM 208C initiation a session manager moduleon replication manager 217. Afterwhich, the SCM 208C loads and validatesthe format of the configuration database 214. At 606, snapshot manager206 generates a snapshot handle including, but not limited to, the CDPengine 110 name, the protection set name, and an event marker name. Asdiscussed above, the snapshot handle can be stored at configurationdatabase 214.

At 608, the snapshot manager 206 identifies which CDP engine 110contains the protection set to be recovered. At 610, snapshot manager206 obtains authentication credentials from configuration database 214.At 612, SCM 208C logs onto the CDP engine 110 using authenticationcredential obtained through the configuration database 214. The logoninstruction is sent through the replication manager 217 to CDP engine110.

At 614, SCM 208C sends a request to CDP engine 110 to surface a copy.This can initiate a surface replica module on replication manager 217.The surface replica module sends an instruction to CDP engine 110 tomount a surfaced copy of the data corresponding to the pseudosnapshotbeing recovered. At 616, the CDP engine 110 surfaces a copy by readingthe data stored on CDP engine up until the event marker representing thepseudosnapshot.

After the copy is surfaced, computer 102 can use the surfaced copy toperform various replication operations. In one embodiment, at 618, SCM208C sends a request to import the surfaced copy from the CDP engine110. This can include initiating a storage discovery module inreplication module 217. At 620, the user makes a selection as to thehost onto which the surfaced copy will be imported. For example, asurfaced copy may be imported into primary storage 120, hardware 210Aand 210B, computer 102, or other onsite or offsite locations.Alternatively, the surfaced copy may be copied into another host. At622, assuming that the user has selected the primary storage 120 onwhich to import or copy the surfaced copy, replication application 106performs a restoration operation on the primary storage 120. That is,the surfaced copy is imported from CDP engine 110 to primary storage120.

At 624, SCM 208C sends a request to CDP engine 110 to submerge thesurfaced copy. This can include initiating a submerge replica module onreplication manager 217. The submerge replica module sends aninstruction to CDP engine 110 to dismount the surfaced copy. At 626,snapshot manager 206 closes the session between replication manager 217and configuration utility 211.

The management of the copy surfacing or recovery process may beaccomplished via graphical user interface 122. The graphical userinterface 122 may provide the user with a visual depiction of allavailable pseudosnapshots that may be recovered via surfacing a copy.The interface between the CDP engine 110, replication application 106,and graphical user interface 122 may create the appearance on thegraphical user interface 122 of a plurality of traditional snapshotsthat may be selected for recovery by the user. In other words, themechanics of creating a pseudosnapshot can be transparent to the userand the user may view the pseudosnapshots the same as other traditionalsnapshots. As described above, when a user selects a pseudosnapshot tobe recovered, the replication application 106 translates this requestinto a surfaced copy containing the appropriate data from the CDP engine110.

A copy may be surfaced for a variety of reasons. For instance, if thedata for production application 104 has recently been corrupted onprimary storage 120, the user can select a pseudosnapshot that wascreated prior to the time at which production application 104 wascorrupted. A copy can be surfaced up until that point and recopied tothe primary storage 120 to replace the lost data. In another example, auser may want to create an additional copy of the surfaced copy for datasecurity purposes. The copy of the surfaced copy may be saved to aseparate disk, tape, or the like, including storage at repositories 115,primary storage 120, and backup storage, as will be further describedbelow. The additional copy may be sent to an offsite location inpreparation for an onsite disaster such as a flood, fire, theft, etc.Another common reason to surface a copy is to recover a prior version ofproduction application 104 following a disaster causing corruption orloss of data on the production application 104. In this case, thesurfaced copy may be loaded onto computer 102 to serve as a recovery forthe corrupted application.

Turning back to FIG. 5, when surfacing the copy related to a particularpseudosnapshot, the surfaced copy can include the data included withinthe write journal 111 from T₀ up to a particular event marker.Therefore, surfaced copy 1 consists of all data included in the writejournal as indicated by the arrow 506A, surfaced copy 2 consists of alldata included in the write journal as indicated by the arrow 506B,surfaced copy 3 consists of all data included in the write journal asindicated by the arrow 506C, surfaced copy 4 consists of all dataincluded in the write journal as indicated by the arrow 506D, andsurfaced copy 5 consists of all data included in the write journal asindicated by the arrow 506E.

In an alternative embodiment, instead of surfacing, for example, all ofwrite journal 111, CDP engine 110 may be able to surface onlyincremental changes. In this embodiment, the replication application 106may request a browse tree from CDP engine 110 that displays the variousevent markers. A user can select from the browse tree a range of time inwhich incremental changes are desired. Thus, the process of surfacing acopy of incremental changes can be similar to surfacing an entire copyfrom T₀, except instead of surfacing a copy from T₀ to an event marker,the data that is surface is from T_(i) to T_(f) as selected by a user.For example, as shown in FIG. 5, an incremental backup can be formedusing data up to event marker 504D at T_(f) less that data up to eventmarker T_(i), the surfaced changes constituting pseudosnapshot 506F. Inother embodiments, a user can select T_(i) to T_(f) to be any otherpoint in time that is not indicated with an event marker.

As mentioned previously, many of the advantages that have traditionallybeen unique to either CDP technology or snapshot technology are combinedinto a single system in accordance with the present invention. Forexample, the present invention benefits from CDP's very fine level ofgranularity, because pseudosnapshots can potentially be created at thesame frequency that data tap 214 sends changes in production application104 to CDP engine 110.

Another advantage of the present CDP-snapshot combination allows forrecovery of data in an “application consistent state.” When anapplication is backed up at a point in time when the entire applicationis in a consistent state, the backup is said to be in an “applicationconsistent state.” One technique used to obtain an applicationconsistent state is to quiesce the application prior to a backupoperation, as described previously.

On the other hand, when a backup is created without quiescing theapplication, it is likely that the backup occurred when the entireapplication was not in a consistent state. When an application is backedup at a point in time when the application is not in a consistent state,the backup is said to be in a “crash consistent state”, i.e., in thesame state it would have been had the system crashed and recovered(e.g., a loss of power) at the time of the backup operation.

Because of the continuous nature of CDP backup operations, data that hadbeen saved to the CDP engine are often saved only in a crash consistentstate. In a typical CDP environment, the CDP makes continuous backups ofan application's reads and writes, but is not cognizant of the needs ofthe actual application. For example, perhaps a disaster occurred whilean application was in the process of performing a complex operation. Byrecovering the most recent data stored in the CDP engine, the resultwill be the recovery of that same application as last saved midwaythrough the complex operation. Thus, the recovered application is merelyin a crash-consistent state. As systems grow more complex, the problemsassociated with crash-consistent backups on the CDP engine escalate. Bycombining CDP with snapshot technology, a user can easily select datafrom the CDP engine that was saved while the application was in anapplication consistent state.

Embodiments included dedicated devices or systems that include bothhardware and/or software components. Embodiments within the scope of thepresent invention also include computer readable media having executableinstructions or data fields stored thereon. Such computer readable mediacan be any available media which can be accessed by a general purpose orspecial purpose computer. By way of example, and not limitation, suchcomputer readable media can comprise RAM, ROM, EEPROM, CD-ROM or otheroptical disk storage, magnetic disk storage or other magnetic storagedevices, or any other medium which can be used to store the desiredexecutable instructions or data fields and which can be accessed by ageneral purpose or special purpose computer. Combinations of the aboveshould also be included within the scope of computer readable media.Executable instructions comprise, for example, instructions and datawhich cause a general purpose computer, special purpose computer, orspecial purpose processing device to perform a certain function or groupof functions.

Those skilled in the art will appreciate that the invention may bepracticed with other computer system configurations, including hand-helddevices, multi-processor systems, microprocessor-based or programmablecustomer electronics, network PCs, minicomputers, mainframe computers,and the like. The invention may also be practiced in distributedcomputing environments where tasks are performed by remote processingdevices that are linked through a communications network. In adistributed computing environment, program modules may be located inboth local and remote memory storage devices.

The present invention may be embodied in other specific forms withoutdeparting from its spirit or essential characteristics. The describedembodiments are to be considered in all respects only as illustrativeand not restrictive. The scope of the invention is, therefore, indicatedby the appended claims rather than by the foregoing description. Allchanges which come within the meaning and range of equivalency of theclaims are to be embraced within their scope.

1. A system for performing replication operations comprising: acontinuous data protection system configured to save a series oftransactions of a production application, the continuous data protectionsystem configured to allow a point in time view of the series oftransactions, wherein the continuous data protection system creates acopy of data involved in a write operation each time data is written bythe production application; a replication application communicating withthe continuous data protection system, the replication applicationconfigured to: initiate generation of at least one pseudosnapshot of theseries of transactions saved on the continuous data protection system,wherein the series of transactions are included in a write journal ofthe continuous data protection system, wherein the pseudosnapshotidentifies a dataset in the series of transaction with an event markerthat identifies a time and date at which the at least one pseudosnapshotis created and that is associated with a particular transaction in theseries of transactions and wherein the event marker identifies a pointin time when the production application is in a quiescent state; andinitiate surfacing of a copy of the dataset from the continuous dataprotection system, the copy including at least the portion of the seriesof transactions that were saved before the generation of the at leastone pseudosnapshot; and a remote server communicating with thereplication application, the remote server configured to sendreplication instructions to the replication application.
 2. The systemas recited in claim 1, further comprising a remote backup storagecommunicating with the remote server, the remote backup storageconfigured to read the surfaced copy and save a first copy of thesurfaced copy.
 3. The system as recited in claim 1, wherein the remoteserver further comprises a client file index configured to maintain arecord of the surface copy.
 4. The system as recited in claim 1, whereinthe remote server further comprises a media volume configured tomaintain a record of a volume at which the surface copy is stored. 5.The system as recited in claim 1, wherein the remote server is furtherconfigured to send the replication application an instruction toinitiate the generation of the at least one pseudosnapshot.
 6. Thesystem as recited in claim 2, wherein the remote backup storage furthercomprises a client file index configured to maintain a record of thesurface copy.
 7. The system as recited in claim 2, wherein the remotebackup storage further comprises a media volume configured to maintain arecord of a volume at which the surface copy is stored.
 8. The system asrecited in claim 2, wherein the remote backup storage is remote from theremote server.
 9. In a system for performing replication operations, thesystem including a replication application, a continuous data protectionsystem and a remote server, the continuous data protection systemconfigured to save a series of transactions of a production application,a method comprising: identifying a request from the remote server togenerate a pseudosnapshot; identifying at least a portion of the seriesof transactions on the continuous data protection system, wherein theseries of transactions includes copies of data that were written by theproduction application to a storage device; identifying an initial timeat which the pseudosnapshot begins; identifying a final time at whichthe pseudosnapshot ends; identifying a last transaction before the finaltime at which the pseudosnapshot ends; and creating the pseudosnapshot,wherein the pseudosnapshot comprises an event marker identifying aparticular point in time that the last transaction was saved on thecontinuous data protection system, wherein the event marker for theparticular point in time corresponds to an application consistent pointin time where the production application is in a quiescent state,wherein the pseudosnapshot enables a copy of the data identified in thecontinuous data protection system by the pseudosnapshot to be surfacedfrom the continuous data protection system.
 10. The method as recited inclaim 9, wherein the initial time at which the pseudosnapshot begins isa time at which the continuous data protection system began saving theseries of transactions.
 11. The method as recited in claim 9, furthercomprising: identifying a last transaction before the initial time atwhich the pseudosnapshot begins; and creating an event markeridentifying a particular point in time that the last transaction wassaved on the continuous data protection system.
 12. The method asrecited in claim 9, further comprising quiescing the productionapplication before creating the event marker.
 13. The method as recitedin claim 9, further comprising maintaining an index of event markers atthe remote server.
 14. The method as recited in claim 9, furthercomprising presenting a user a graphical user interface to allow theuser to schedule one or more pseudosnapshots.
 15. The method as recitedin claim 14, wherein the user is able to specify only a portion of theseries of transactions to be included in the pseudosnapshot.
 16. Themethod as recited in claim 9, further comprising authenticating theremote server to access the continuous data protection system prior tocreating the event marker.
 17. In a system for performing replicationoperations, the system including a replication application, a continuousdata protection system and a remote server, the continuous dataprotection system configured to save a series of transactions of aproduction application, a method comprising: identifying a request fromthe remote server to surface a copy of data relating to a pseudosnapshotfrom the continuous data protection system, wherein the pseudosnapshotcomprises an event marker that includes information regarding a time atwhich the pseudosnapshot was created and at which a last change was madeto the continuous data protection system, wherein the pseudosnapshotidentifies a dataset within the continuous data protection system thatcan be reliably surfaced as the copy of data using the event marker;identifying an initial time at which the pseudosnapshot begins using theevent marker; identifying a final time at which the pseudosnapshot endsusing the event marker; copying the transactions in the series oftransactions between the initial time and the final time, wherein theevent marker corresponds to an application consistent point in timewhere the production application and the data of the productionapplication are in a quiescent state; presenting the copied transactionssuch that the copied transactions can be read by a remote backupstorage; and saving the copied transactions to a remote backup storage.18. The method as recited in claim 17, wherein the initial time at whichthe pseudosnapshot begins is at least one of: a time at which thecontinuous data protection system began saving the series oftransactions; or a later time after the time at which the continuousdata protection system began saving the series of transactions.
 19. Themethod as recited in claim 17, further comprising maintaining, at theremote server, a record of the saving of the copied transactions to theremote backup storage.
 20. A system for performing replicationoperations comprising: a continuous data protection system configured tosave a series of transactions of a production application, thecontinuous data protection system configured to allow a point in timeview of the series of transactions, wherein the continuous dataprotection system creates a copy of data involved in a write operationeach time data is written by the production application; a replicationapplication communicating with the continuous data protection system,the replication application configured to: initiate generation of atleast one pseudosnapshot of the series of transactions saved on thecontinuous data protection system, wherein the series of transactionsare included in a write journal of the continuous data protectionsystem, wherein the pseudosnapshot identifies a dataset in the series oftransactions with an event marker that identifies a time and date atwhich the at least one pseudosnapshot is created and that is associatedwith a particular transaction in the series of transactions and whereinthe event marker identifies a point in time when the productionapplication is in a quiescent state; index the at least onepseudosnapshot in an index of pseudosnapshots; present the at least onepseudosnapshot in a graphical user interface using the index to identifythe at least one pseudosnapshot that can be accessed at a later point intime, wherein the at least one pseudosnapshot is viewed as a snapshot inthe graphical user interface; and initiate surfacing of a copy of thedataset, the dataset including at least a portion of the series oftransactions that were saved before the generation of the at least onepseudosnapshot; and a remote server communicating with the replicationapplication, the remote server configured to send replicationinstructions to the replication application.